Complex Verbs are Different: Exploring the Visual Modality in Multi-Modal Models to Predict Compositionality
نویسندگان
چکیده
This paper compares a neural network DSM relying on textual co-occurrences with a multi-modal model integrating visual information. We focus on nominal vs. verbal compounds, and zoom into lexical, empirical and perceptual target properties to explore the contribution of the visual modality. Our experiments show that (i) visual features contribute differently for verbs than for nouns, and (ii) images complement textual information, if (a) the textual modality by itself is poor and appropriate image subsets are used, or (b) the textual modality by itself is rich and large (potentially noisy) images are added.
منابع مشابه
A Comparative Analysis of Epistemic and Root Modality in Two selected English Books in the Field of Applied Linguistics Written by English Native and Iranian Non-native Writers
Academic discourse has always been the focus of many linguists, especially those who have been involved with English for Academic Purposes (EAP) and discourse analysis. Persuasion, as part of rhetorical structure of academic writing, is partly achieved by employing modality markers. Adopting a descriptive design, the present study was carried out to compare the use of modality markers in terms...
متن کاملThe Acquisition and Development of the Concepts of English Modality Through Metaphors
The current study attempted to investigate the effect of Systemic-Theoretical Instruction (STI) on English-language learners’ acquisition of the concepts of modal verbs through exploiting metaphors. To this end, the effect of the main treatment of the study, i.e. Concept-Based Instruction (CBI) was investigated through conceptual metaphors, in two gender (male vs. female) ...
متن کاملHow textbooks (and learners) get it wrong: A corpus study of modal auxiliary verbs
Many elements contribute to the relative difficulty in acquiring specific aspects of English as a foreign language (Goldschneider & DeKeyser, 2001). Modal auxiliary verbs (e.g. could, might), are examples of a structure that is difficult for many learners. Not only are they particularly complex semantically, but especially in the Malaysian context ...
متن کاملLearning English Auxiliary Modal Verbs by Iranian Children
Modal verbs in English are challenging to learn by speakers of other languages. The purpose of thiswas to shed light on the use of gesture in learning English modal verbs by Persian-speaking children.To achieve this, 60 elementary Iranian learners, studying at some institutes in Karaj took part in thisstudy. The participants were randomly put into one experimental group and one control group. T...
متن کاملExploring Vector Space Models to Predict the Compositionality of German Noun-Noun Compounds
This paper explores two hypotheses regarding vector space models that predict the compositionality of German noun-noun compounds: (1) Against our intuition, we demonstrate that window-based rather than syntax-based distributional features perform better predictions, and that not adjectives or verbs but nouns represent the most salient part-of-speech. Our overall best result is state-of-the-art,...
متن کامل